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Abstract 



We introduce a high dimensional symplectic map, modeling a large sys- 
tem consisting of weakly interacting chaotic subsystems, as a toy model to 
analyze the interplay between single-particle chaotic dynamics and particles 
interactions in thermodynamic systems. We study the growth with time of 
the Boltzmann entropy, Sb, in this system as a function of the coarse grain- 
ing resolution. We show that a characteristic scale emerges, and that the 
behavior of Sb vs t, at variance with the Gibbs entropy, does not depend 
on the coarse graining resolution, as far as it is finer than this scale. The 
interaction among particles is crucial to achieve this result, while the rate of 
entropy growth depends essentially on the single-particle chaotic dynamics 
(for t not too small). It is possible to interpret the basic features of the 
dynamics in terms of a suitable Markov approximation. 

Keywords: Boltzmann entropy, irreversibility, chaotic dynamics, ensembles. 

1 Introduction 

Statistical mechanics was founded by Maxwell, Boltzmann and Gibbs for systems 
with a very large number of particles. Given their different approaches, Boltzmann 
and Gibbs are often considered as the champions of two different points of view 
about statistical mechanics. This common vulgata takes Gibbs as the founder of the 
ensemble approach, and Boltzmann as the promoter of a dynamical theory based 
on the ergodic hypothesis; according to this tradition, modern textbooks |T] use 
Gibbs's terminology for the ensembles (i.e. microcanonical, canonical and grand- 
canonical). Actually, both ergodicity and ensembles are Boltzmann's inventions; 
more detailed discussions about Boltzmann, Gibbs, and the origin of the statistical 
mechanics are contained in the absolutely recommendable book by Cercignani j2] , 
and the papers by Klein jB], Lebowitz @J, and Gallavotti [H]. 

The Gibbs' approach to statistical mechanics uses the general concept of en- 
sembles without any reference to the precise origin of such an idea. The relevant 
literature is huge [SJ Ej : sometimes the ensembles are derived from philosophi- 
cal considerations, other times from information-theoretic, and even from anthro- 
pocentric considerations. In Van Kampen's words, sometimes this produces a 
slightly mystic aura, which diverts the attention away from the physical meaning 
of the ensemble theory [7j. 

Ergodic theory begins with Boltzmann's attempt to justify the determination 
of average values in kinetic theory E|. Macroscopic systems contain a very 
large number (of the order of the Avogadro's number) of particles; this implies the 
practical necessity of a statistical description. Since in any macroscopic observation 
the time scale is much larger than the microscopic time scale, over which the 
molecular changes take place, an experimental measurement is actually the result 
of an observation on a single system, during which it goes through a very large 
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number of microscopic states. Thus, one may assume that the outcome of the 
measurement of an observable A(X) is an average performed over all these states: 
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where the vector 



X(t;X ) 



(qi(t; X ), . . . , q N (t; X ), pi(t; X ), . . . , Pjv(*5 X )) 



(2) 



lies in the 6 N - dimensional phase space T, gives the state of the system at time t 
and, in general, depends on the initial state X . According to the usual notation, 
the components of X, qj and p^, indicate the position and momentum vectors of 
the i-th particle. 

Obviously, it is impossible to obtain the complete description Xo of the micro- 
scopic state of the system at the initial time, for such high-dimensional systems 

— T 

as those relevant in statistical mechanics. This means that, if A depends too 
strongly on the initial condition, no statistical predictions can be made, indepen- 
dently of how difficult it may be to integrate the equations of motion. The ergodic 
hypothesis allows us to overcome this obstacle, stating that for sufficiently large T, 

— T 

the average A depends only on the system energy, in the sense that it takes the 
same values for almost all 1 the trajectories on the given constant energy surface. 
This allows us to identify the time average with a phase space average: 



where P mc is the microcanonical probability density, except for a negligible set of 
initial conditions. The validity of such an equality eliminates the necessity of de- 
termining the initial state of the system, and of solving the Hamilton's equations. 
Whether Q is valid or not, i.e. whether it is possible to substitute the temporal 
average with an average in phase space, constitutes the essence of the ergodic prob- 
lem in physics. The relevance of this issue is evident: let the statistical properties 
of a large isolated system be properly described by the microcanonical ensemble, 
then it is not difficult to show that a small part of the given system, which is still 
large at the microscopic scale, is described by the canonical ensemble. 

We stress that, in this context, the ensemble is just a useful mathematical tool, 
and one should not forget that thermodynamics, as a physical theory, is developed 
to describe the properties of single systems, made of many microscopic, interact- 
ing parts. Although some may find hard to distinguish between "thermodynamic 
systems" and other systems of interest in statistical physics, in this paper, when 
referring to a thermodynamic system, we have in mind a system that is character- 
ized by macroscopic properties such as its temperature, while many other, equally 

1 Hcrc, almost all has a technical meaning, i.e. it refers to all trajectories, except those which 
originate in a set of vanishing phase space volume. 
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interesting physical systems, do not even need to have a temperature. The dis- 
tinction makes sense because different laws describe the behaviour of the different 
systems. 

To justify eq. Q in physical systems, Khinchin's point of view clearly states 
that the success of statistical mechanics techniques is mainly due to the many 
degrees of freedom, while the underlying dynamics play only a minor role. In his 
celebrated book Mathematical Foundations of Statistical Mechanics , he presents 
some important results on the ergodic problem which do not rest on the metrical 
transitivity of the dynamics, which Q requires. Khinchin's idea on the ergodic 
problem in statistical mechanics is that one should profit from the fact that macro- 
scopic systems have a large number of degrees of freedom, and that the physical 
observables for which (jSJ) is required to hold are not generic regular functions, as in 
the dynamical systems approach to ergodicity. In other words, taking into account 
the large number of degrees of freedom should be enough to obtain the validity of 
the equivalence between time averages and ensemble averages for the small class of 
relevant observables. Moreover, it is fair for physical purposes to accept the failure 
of the ergodic hypothesis for a set of initial conditions X which is a negligible 
fraction of the phase space, or that becomes negligible when N oo. In a nut- 
shell, Khinchin's point of view is that statistical mechanics works independently of 
the mathematical validity of the dynamical systems notion of ergodicity, because 
the physically relevant observables are practically constant, except in an irrelevant 
region of the constant energy surface. This makes marginal the role of the dynam- 
ics, for equilibrium states, and the existence of good statistical properties is mainly 
due to the large number of degrees of freedom, i.e. to N ^> 1. 

The ergodic approach, whether in its strong or its weak version, is a natural 
way to introduce probabilistic concepts in a deterministic context: in experimental 
situations one deals with a unique system with many degrees of freedom, whose 
microstates explore with given frequency the different regions of the phase space. 
Consequently, the ergodic hypothesis seems to provide the appropriate tools for 
the equilibrium statistical mechanics to be founded on physical grounds, using a 
frequentistic interpretation of the probability distributions. 

The other way of connecting probability and dynamics (which does not contrast 
with Boltzmann's point of view) is to take into account the unavoidable uncertainty 
on the initial conditions. This approach, originally due to Maxwell, considers that 
there are a great many systems the properties of which are the same, and that each 
of these is set in motion with a different set values for the coordinates and momenta 

The discovery of deterministic chaos, implying that even deterministic systems 
with a few degrees of freedom may present some statistical features typical of prob- 
abilistic evolutions, forced the physicists to reconsider from a new perspective the 
foundations of statistical mechanics [TT]. Moreover one may also find useful to 
define, formally, "thermodynamic" system any system with ergodic dynamics such 
that (J3J) applies. In this paper we will consider only systems with many degrees of 
freedom, such that, usually, the thermodynamic observables have negligible fluc- 
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tuations. 

The situation is much more intricate for the non equilibrium problems than 
for equilibrium ones, and even after many years of debate, there is no general 
agreement about the fundamental ingredients needed for statistical mechanics to 
hold. 

The aim of this paper is to give a contribution for the understanding of the 
role of deterministic chaos, and of coarse-graining procedures, in non equilibrium 
statistical mechanics. In particular the paper concerns the problem of the growth 
of entropy. These issues are the source of heated debates, on which only partial 
agreement has been reached within the statistical mechanics community. Recent 
examples of this are given by the debate on irreversibility originated by Lebowitz's 
paper 0], and the partly contrasting views on irreversible entropy production re- 
ported in na nsi 2 

Our results support the view that systems of many noninteracting chaotic par- 
ticles may properly describe, for some aspects, highly rarefied gases, or Knudsen 
gases in an irregular container, even if a normal thermodynamic behavior may be 
absent. 3 This is a very delicate issue: it is known ^Hl Q3| that some form of ir- 
reversibility may be found in systems of non interacting particles. For example, 
free particles in a box show homogenization of the spatial coordinates; in irregu- 
larly shaped boxes the distribution of velocity can become isotropic; but, in the 
absence of interactions, a relaxation of velocities to a Maxwellian (that we call, 
as noted above, a normal thermodynamic behaviour) is impossible. We find, in 
fact, that the r or \x space graining required for noninteracting particle systems 
to look thermodynamic-like have an equally arbitrary character, with no physical 
meaning, and play an essentially identical role in both spaces. 

Differently, we are going to show in this paper that, in the case of interacting 
chaotic particles, a characteristic scale naturally emerges in the \x space. This 
may be interpreted as the scale at which the diffusive, small scale behavior due 
to the interaction first smoothes the fragmented structures created by the chaotic 
dynamics. In this case, the coarse graining in /i-space shows completely different 
features from the coarse graining in T space: in particular, the growth of the 
Boltzmann entropy results independent of the resolution, as long as the observation 
scale is finer than the characteristic scale. We stress that to achieve this result, it 
is of fundamental importance that the number of particles must be large, which is 
not required for the coarse graining in T-space. 

These facts are reflected in the different nonequilibrium behaviours of the Boltz- 
mann and Gibbs entropies. Indeed, the constancy of the Gibbs entropy can be 

2 As a matter of fact, the views expressed in Refs.[T3] are not particularly contrasting with 
those of Refs.fTI). as they all require the condition of local thermodynamic equilibrium, and do 
the coarse graining in //-space rather than in T-space. 

3 The lack of interactions imparts very interesting and useful (cf. Ref. |16llT7j ) properties to such 
gases, not their number density. Therefore, the behaviour of a system of noninteracting particles, 
like that of a Knudsen gas, is dominated by the collisions with the walls of its container, even if 
its number of particles per unit volume is high. 
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consistently accommodated in this framework. If one accepts, as we do, that the 
Gibbs canonical ensemble does yield the correct equilibrium thermodynamics, then 
the dynamical invariance of the Gibbs entropy may provide a simple interpreta- 
tion of the second law of thermodynamics [20] ■ One considers the ensemble of 
points in T space, that are compatible with the values of the macroscopic vari- 
ables {Afc}, defining the initial equilibrium thermodynamic state, and that are 
weighted by the suitable Gibbs density p(X). For large systems, the quantity 
Hc{{p}) = J jo(X) lnp(X)dX allows to determine a phase space region R, whose 
volume is Ar = exp[— Hc{{p}}, containing the "reasonably probable" microstates. 
As a consequence of an adiabatic change of state, the microstates in R evolve, and 
after a sufficiently long time T, so that a new equilibrium is attained, they occupy 
the new region R T , whose volume, because of the Liouville equation, is still Ar. 
However, the quantities defining the new thermodynamic equilibrium are {A^}, 
evolved from {A^}. These values define the new Gibbs density p(X), with a support 
essentially contained in a region R of volume Ar = exp[— Hg{{p}}- Since we ac- 
cept that, at equilibrium, S = —k B f p(X) lnp(X)dX = — k B H G ({p}) = k B In Ar, 
the second law of thermodynamics requires that Ar > Ar. What is important to 
note here is that p(X), and therefore Ar, is not determined by the evolution of the 
initial p(X), it is constructed by the evolved values of the macrovariables {A^}. 
A demonstration of the second law in statistical mechanics, in this framework, is 
equivalent to show that the microstates, compatible with the set of macroscopic 
variables, suitable to describe the thermodynamic system at hand, during an adi- 
abatic evolution occupy phase-space regions of increasing volumes [21]. This fact 
guarantees the experimental reproducibility of the process. On the other hand, 
as Jaynes writes [20]; 'Any really satisfactory demonstration of the second law 
must therefore be based on a different approach than coarse-graining [of p] " , since 
"the decrease of H [a coarse-grained version of H G ({p})} is due only to the artificial 
coarse-graining operation and it cannot therefore have any physical significance...". 

In the case of a dilute gas, a useful macroscopic variable to define the thermo- 
dynamic state of the system, is the single particle distribution function /(q, p,t). 
In this case, and only in this case, the logarithm of the volume occupied by 
the compatible microstates is given by minus the Boltzmann if-function: Hb = 
J P; t) ln/(q, p, t)dqdp. So, for a dilute gas, while the Gibbs entropy, as al- 
ways, is expected to be constant, the Boltzmann entropy takes the form: Sb = 
—k B J /(q, p, t) In /(q, p, t)dqdp and is expected to increase, as Lanford [22] demon- 
strated to be true, in a suitable limit. 

Most of the ideas discussed in the present paper are known. See, for instance, 
PT] for the graining in phase space induced by a graining in p-space and the 
choice of macro- variables, and for the relation between the one-particle distribution 
function of interacting and of noninteracting particle systems. Here, we express in a 
quantitative form, for a specific model, the qualitative statements made elsewhere, 
and we observe the existence of an intrinsic scale for the graining in the p-space of 
interacting particle systems. 
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This paper is organized as follows. Section II is devoted to a brief summary of 
some basic facts about Gibbs and Boltzmann entropy and the link between deter- 
ministic chaos and statistical mechanics. In section III we introduce a symplectic 
map simulating the time evolution of a large system, consisting of weakly interact- 
ing chaotic subsystems, and we show the behavior of the Boltzmann entropy Sb 
vs time. The main result is that, for interacting systems, Sb is independent of the 
details of the coarse-graining procedure in /z-space, if the graining is sufficiently 
fine, i.e. the existence of an intrinsic graining scale in /x-space. The most remark- 
able fact is that some numerical aspects (e.g. the slope of Sb for large enough t) 
basically depend only on the chaotic properties of the single subsystem, but the 
presence of the coupling is absolutely necessary. In section IV we show how one 
can interpret the results with a mechanism similar to that used for the decoherence 
in the semiclassical limit of quantum mechanics. Conclusions and perspectives are 
in section V. 



2 On the Gibbs and Boltzmann entropy 

Let us consider a Hamiltonian system of N particles, and the vector X(t) which 
defines the microscopic state of the system. Denoting by p(X)c?X the probability 
for the microscopic state to be found in the phase space volume cO£, one defines 
the Gibbs entropy: 

S G ({p}) = -k B J p(X)\np(X)dX (4) 

where k B is the Boltzmann's constant. Since the time evolution X(0) — > X(£) is 
ruled by the Hamilton equations, the Liouville theorem implies that Sq does not 
change in time. However, a coarse graining of p by cells of size A in the V space (the 
microscopic phase space) leads to an increase of the coarse-grained Gibbs entropy 4 

S G (t,A) = -k B Y^p A (i,t)lnp A (i,t) , (5) 

i 

where the coarse-grained probability p&(i,t) is given by: 

Pa(M)= / P(X,t)dX, (6) 

J Aj a 

and Aj A is the cell in the space V of linear size A centered in the point X^\ When 
the system is chaotic, and the initial probability distribution is supported over 
a small region of linear size a, simple arguments suggest that Sa(t,A) increases 

4 It is worth recalling that Sc{t,A) is the discretization of Sq, by cells of size A, except for 
an additive term k B In A. At fixed A, the term is constant and not relevant if one considers the 
entropy differences with respect to the initial values. 
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linearly in time, after a short transient of length t\ 



S G (t,A)-S G (0,A)~ 



t < t x 

h K s{t -t x ) t> t x 



(7) 



where hxs is the Kolmogorov-Sinai entropy of the system, 
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and Ai is the first Lyapunov exponent of the Hamilton equations. The prediction 
of Eq (0) is not always completely correct; actually, it is valid only when intermit- 
tency effects are negligible ■ To make things simpler we will assume the validity 
of Eq.((7j), as commonly done in the presence of chaotic dynamics. Many consider 
Eq. (J7J) as a proof of the deep connection between chaos and irreversibility. Nev- 
ertheless, the result of Eq. (J7|) does not have a genuine thermodynamic character. 
This can be understood as follows: 

a) the quantity Sa(t, A) describes properties of the T space that can not be 
computed from a single-system measurement; 

b) the time increase of Sa(t, A) depends on the coarse-graining procedure and 
this appears as a non-ontological result; 

c) the result of Eq.((7j) is valid also for a generic, low- dimensional system - notice 
that one obtains the same result even in the case of chaotic non-interacting 



Consider now the Boltzmann point of view, for a system of iV weakly inter- 
acting particles. The one-body probability distribution function /(q, p, t), i.e. the 
probability density of finding a particle in a given volume of the /i space (the 
single-particle space) can be introduced without any reference to an ensemble of 
macroscopically identical systems, each represented by a point in T space. In fact, 
take a single system made of a large number N of identical particles, consider the 
discrete distribution 



and let N grow. As the number N of the particles of this unique system tends to 
infinity, a non-singular one-particle probability distribution (in \i space) must be 
constructed 5 Using Eq.flHJ), and assuming that the physical space is <i-dimensional, 
this can be done introducing a cell size A in \x space, such that N ^> A~ 2d , i.e. 

J This is needed for the Boltzmann entropy to exist, like a non-singular distribution in T space 
is required for the Gibbs entropy to exista 



particles. 




(9) 



i=0 
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that there is a statistically relevant number of particles in each cell. Then, define 
the one-particle coarse grained distribution: 



A ' ■ 2|p'«-p,(()| 



i=0 ^ ' ^ 



A 



(10) 



where Q(z) is the Heaviside step function and p( k > are the coordinates of the 
center of each cell Cjk having linear size A, and volume A 2d , in the appropriate 
units. The Boltzmann entropy is then defined by 

S B (t) = -k B J /(q,p,f)ln/(q,p,*)dqdp (11) 

where / is the regular /z-space probability distribution, obtained in the iV — > oo, 
A — ► limit of Eq. (jlUj) . The Boltzmann entropy, as defined in Eq. (jllj) . is a natural 
candidate for the description of dilute systems, for which it represents the logarithm 
of the volume occupied by the macrostate in the T space: 

S B = k B \ogAT. (12) 

Moreover, for dilute systems under the hypothesis of molecular chaos the celebrated 
Boltzmann's H-theorem holds: 

^ > 0. (13) 

The validity of the molecular chaos hypothesis has been demonstrated for the class 
of dilute systems in the Grad limit, where N — > oo and the interaction range goes 
to zero in order to keep the total cross section constant [221I2II- 

Some textbooks try to connect the two main approaches noticing that in dilute 
systems: 

N 

P {x,t)~ n/(q*>pj>*) ( 14 ) 

3=1 

which implies that Sq — NS B . This attempt, however, is only partially justified, as 
there are at least two important conceptual differences between these approaches: 

• The Gibbs point of view is based on the ensemble, i.e. on an abstract collec- 
tion of macroscopically identical systems, and does not depend on the number 
of particles of which each system is made. Differently, Boltzmann's approach 
does not require an ensemble of copies of the same system, but needs iV 1 , 
in order to compute /(q, p, t) for the single system. 

• The Gibbs entropy deals with the T space, and necessitates a coarse graining 
procedure in order to avoid the consequences of the Liouville theorem, and 
to grow during an irreversible evolution. In the Boltzmann approach, the 
entropy can grow despite the Liouville theorem, and the graining of the \x- 
space is only introduced to deal with a smooth distribution. 
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In addition, the validity of (|14|) must be interpreted cum grano salis, otherwise, 
because of one would erroneously infer that the Gibbs entropy (jlj) grows. 

In the following, we will show that for long enough times, and non-vanishing 
interaction, the growth of Sb does not depend on the cell size, which is not the 
case for non-interacting systems. 

3 The Boltzmann entropy of a chaotic system 
3.1 The discrete time model 

In order to discuss the points mentioned above in a concrete fashion, let us start 
with a system consisting of N ^> 1 non-interacting particles moving in a periodic 
array of fixed convex scatterers, with which they collide elastically. 

The position of the scatterers should avoid the presence of collisionless trajec- 
tories, i.e. the horizon should be finite. It is well established that such a system, 
commonly known as the Lorentz gas 6 is chaotic and displays asymptotic diffusion. 
The Gibbs entropy of such a system obeys Sa(t) = Sg(0), while the coarse-grained 
entropy increases linearly with t for t > t\ (before saturation). It is easy to see 
that hxs = Nhi, where h\ is the Kolmogorov-Sinai entropy of a single particle, 
and Sb = (Sq)/N = constant, because the particles are independent, and the 
probability distribution in phase space factorizes in iV identical terms. 

The situation is quite different in the case of interacting particles, such as the 
case of the generalization of the Lorentz gas given in Ref . |25j . There, the particles 
are not point-like, but have a finite size, and therefore they collide not only with 
the scatterers, but also among themselves. 

Unfortunately, the study of such a system, for a sufficiently large number of 
particles, is very expensive from a computational point of view. However, a rea- 
sonable substitute for such a system, which shares its main features, can be given 
in terms of symplectic maps. For instance, one can consider a two-dimensional 
map, with one "coordinate" and one "momentum", in place of each particle of the 
generalized Lorentz gas, and one can introduce a form of interaction among these 
"particles". Thus we require that: 

• in the absence of interactions among the "particles", the single-particle dy- 
namics in the corresponding [i space be chaotic and volume preserving; 

• in the presence of interactions among particles, the dynamics of the whole 
system, described by the vector X = (Q, P), Q = (qi . . . q n ), P = (pi . . .p n ), 
be symplectic and volume preserving in the T space. 

The resulting model will be numerically easier to handle, still having some impor- 
tant properties of the particle system. In particular, the dynamics of the interacting 

6 In Lorentz's original model, the moving particles were considered in thermal equilibrium with 
the scatterers, which is impossible to achieve without energy exchanges between scatterers and 
particles, as in the present model. 



10 



(15) 



case will not be volume preserving in the \i space. To this aim, we introduce the 
symplectic map: 

qi = dG(Q',P)/dpi mod 1 
v \ = dG(Q',P)/dq' i mod 1 

whose generating function G(Q', P) is defined by: 

|p|2 N Ng 

G(Q', P) = Q'P-y-^EE cos ^ ~ " 

i=0 j=0 
N Atf/2 

-^EE cos [2tt(^ - q' i+n )] (16) 

i=0 n=-M/2 

with qi, pi e [0, 1]. Ns is the number of fixed "obstacles" having positions Yj, which 
play the role of the convex scatterers in the Lorentz gas, and N is the number of 
"particles". The parameters k and e represent the interaction strength between 
particles and obstacles and among particles respectively. If k — e — one has 
free particles. The functional form of the generating function is reminiscent of the 
standard map, which is a paragon of symplectic dynamics. The boundary con- 
ditions on the variables are periodic, and the form of the interactions does not 
present discontinuities at the boundaries. In order to make the numerical simula- 
tions faster, we assume that each particle interacts only with a limited number M 
of other particles. 

Substituting Eq. lfTHjl into (fTHjl . one finds: 

Qi = li+Pi mod 1 

A/ 

V\= Pi + kJ2 sin [ 27r ~ Y j)} + e E sin[27r (qi - q' i+n )\ modi 

3=0 n=-f 

Since the system is symplectic, the dynamics described by the points (Q, P) will 
preserve volumes in phase space. 



3.2 Numerical results 

In the following, we calculate the Boltzmann single-particle distribution for a given 
cell size (cf. Eq.((TUJ)), as a function of time. Then, we study the growth of the 
corresponding Boltzmann entropy with time, defined by 

S B (t,A) = -k B J2fA(q {j) ,P ik \t)logf A ( q ^,p^,t) (18) 

by varying the interaction strength e and the cell size A. Note that, in our nu- 
merical computations, where we set k B = 1 for convenience, there are no a priori 
assumptions such as, for example, the hypothesis of molecular chaos. In other 
words, the quantity f^q.p.t) evolves according to the exact dynamics. 
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Let us comment on the use of the entropy defined in Eq. (|18|) for our dynamical 
system. As discussed in the Introduction, this expression is correct (in the sense 
that it measures the interesting volume of phase space) only in the case of dilute 
systems. For systems, where the potential energy is not a tiny fraction of the 
total, it has been proposed [2TJ that a similar recipe may still be used, with 
the prescription to count only microstates corresponding to a fixed total energy E. 
Since we are considering the case of weakly interacting subsystems, the function 
f(q,p,t) is able to properly describe the macrostates of the system 

First of all, we choose the number of obstacles N$ and the parameter k (both 
related to the single-particle chaotic behavior) in such a way that a) the Lyapunov 
exponent of the single particle dynamics is not too large and b) there are no KAM 
tori, of the kind which constitute barriers for the transport. One possible choice, 
which realizes this requirement is Ns = 10 3 and k = 0.017. The obstacles positions 
are selected at random, with a uniform p.d.f. The result is that the Lyapunov 
exponent is A ~ 0.162. An example of a trajectory in the 1-particle (q,p) space is 
shown in Fig^ 
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Figure 1: A trajectory generated by 10 4 map iterations in the phase space of a 
single particle, with N s = 10 3 , k = 0.017,6 = 0. 

For the number of particles, we chose N = 10 7 , after checking that finite size 
effects are negligible for this N, and we let the simulations run for different values 
of e. We checked that the results basically do not change when the number of 
particles is reduced by a factor 10. As initial non-equilibrium condition, we take a 
cloud of points distributed according to a Gaussian of r.m.s.d a = 0.01, having the 
point (q,p) = (1/4, 1/2) as a center (we checked that this point is far enough from 
the surviving regular islands, see Fig. Q). At each time, we compute the differences 
between the entropy and its initial value at several resolutions A : 

8S(t, A) = S(t, A) — S(0, A). (19) 
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Figure 2: 8S(t, A) with e = (non-interacting particles) as a function of t for 
different values of A. The slope of the straight line equals Lyapunov exponent. 
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Figure 3: 5 S sit, A) with e = (non-interacting particles) as a function of A, for 
small values of t (left) and large values of t (right). In the left panel, the dotted 
line shows the expected behavior dSsit, A) oc A 2 , while the logarithmic behavior 
is clearly visible in the right panel (notice the log-linear scale). 



We begin with the study of the e = case. The entropy growth shown in FigEl 
is only due to the discretization procedure, since the equation ruling the evolution 
of f(q,p,t) obeys the Liouville theorem. This means that the "true" Boltzmann 
entropy for A — > is constant in time. As shown in Fig|21 the curves of the entropy 
differences as functions of time stay constant up to a time t\ depending on A. After 
this transient, the slope of 5S(t, A) is practically the same for all the curves and 
is approximately given by h^s ( see EqJTj). Looking at the curves of the entropy 
differences as a function of A (see FigJSJ), it is possible to extrapolate the behavior 
for A — > 0: far from the saturation (i.e. for small times) and for A not too large, 
these curves are well fitted by a power law: 

SS B {t,A) oc A 2 . (20) 

This result suggests that the relevant parameter for understanding the finite res- 
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olution behavior of the entropy differences is the cell area A 2 ; moreover, these 
differences go correctly to zero when A — * 0. For t larger than t\, one observes 

5S B (t,A) = alog(A) + 6. (21) 

Of course, the behavior of Eq. (jSOj) and (|2*T|) is consistent with Eq.([7]l. taking into 
account that the rate of entropy growth after t\ is generally different from the 
Lyapunov exponent, leading to a ^ 1 |2*3] . 

We consider now the "interacting" case, i.e. e > 0. Figure 0] and 03 show the 
curves of 5Sb (t, A) as a function of t and A. In this case, the entropy curves as 
a function of A do not extrapolate anymore to zero (see Fig. EJ); these curves, for 
small (fixed) times, are well fitted by a polynomial like: 

6S B (t,A) ^c + Cl A 2 . (22) 

After a characteristic time depending on e, t*(e, A), the entropy shows just a 
weak (logarithmic) dependence on A and correctly extrapolates to a finite value 
when A — > 0. 




Figure 4: SSsit, A) with e = 10 4 as a function of t for different values of A. The 
straight line slope equals the Lyapunov exponent. 

Let us now summarize and comment the previous results: 

a) for non-interacting systems (e = 0), the growth of SSsit, A) reflects the 
properties of the observation tools, i.e. 5Sb — for t < t\(A) and SSg ~ 
X(t — t\(A)) for t > £a(A), has a kind of "subjective" character. Since t\ 
increases as A decreases, not only does the value of the entropy depend on 
the coarse graining, but the entropy growth depends (for "small" t) on the 
resolution scale, as noticed in [Llj . 
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Figure 5: <5>Sb(£, A) with e = 10~ 4 as a function of A for small values of t (left 
panel) and large values of t (right panel). In the left panel the line shows the 
expected behavior c + C]A 2 while in the right panel 5S#(t, A) shows a weak de- 
pendence on A for A — > 0. 




Figure 6: Extrapolation for A — > of the curves SSsit, A) as a function of t for 
various values of e. 

b) For weakly interacting systems, there is an effective cell size A*(e, A), such 
that if A < A*(e, A) the value of SSsit, A) does not depend on A. Here, the 
entropy growth is an objective property, meaning that the limit for A — > 
of SSsit, A) exists, is finite, hence is an intrinsic property of the system (cf. 
Fig£J). 

c) The role of chaos in the limit of vanishing coupling is relevant, i.e. the slope 
of SSs(t,A), for t large enough, is given by the Lyapunov exponent, but 
the existence of an effective cell size A*(e, A) and the corresponding £*(e, A) 
depends on the coupling strength e, and on A. 

d) In the above procedure, i.e. in the evaluation of Eqs. (fTUJl and ()18|). there are 
no assumptions like the hypothesis of molecular chaos or of system's dilution. 
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From a mathematical point of view, we can define Ss{t, A) in Eq.(|18|) in full 
generality. However, we consider only the weakly interacting limit of small 
e for the physical reason that only in such does f(q,p,t) afford an 

appropriate thermodynamic meaning. 

e) For small values of e, the time evolution of f{q,p,t) is different from the 
case e = only on very small graining scales; in other words, the coupling is 
necessary for the "genuine" growth of the entropy, but it does not have any 
dramatic effect on f(q,p,t) at scales A < A*. Indeed, as shown in Fig|?l 
the noninteracting and the weakly interacting cases do not appear to be so 
different, in terms of the single-particle phase space distribution. 




Figure 7: Snapshots of the evolution of the system in the single-particle projection 
of the phase space in the non-interacting case (left), and in the interacting case 
with e = 10~ 4 (right) and M = 100, at increasing times from top to bottom, as 
indicated in the figure. 



4 Interpretation of the results 

The results of the previous section suggest the following interpretation: since the 
number of particles is large, one can expect that the effect of the interaction on each 
particle may be reasonably described by some kind of thermal bath. The single 
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particle dynamics can then be mimicked by chaotic dynamics (corresponding to 
the symplectic map of Eq. (jl7j) with e = 0) coupled to a noise term whose strength 
is 0(e): 

qi(t + l) =qi{t)+Pi{t) mod 1 

Piit + l) = p i (t) + kJ2sin[2n(q l (t + l)-Y j )} + V2Dr) i (t) modi 

(23) 

where ^i(t)'s are i.i.d. Gaussian variables with zero mean and unitary variance, i.e. 

(Vi(t)) = 0, ( Vl (t)v j (t')) = 5t,t'S l ,r (24) 

With this approximation, one basically assumes that f{q,p,t) evolves according 
to a discrete time Fokker-Planck equation. Supposing that each particle gives an 
uncorrelated contribution to the noise term, one can roughly estimate the diffusion 
coefficient D as Me 2 / '4. This heuristic estimate is well supported by numerical 
simulations of (f*T7j) : the quantity SSB(t, A) practically does not change at varying 
M and e, keeping Me 2 constant. 

In this framework, one can introduce a characteristic time t c , defined as the time 
in which the scale of the noise induced diffusion reaches the smallest scale originated 
by the deterministic chaotic dynamics [27] ■ This definition of t c would correspond 
to £*(£, A) introduced above. Consequently, noting that the typical lengths due to 
noise and to chaos behave as ^jMe 2 t/2 and crexp(— At), respectively, the time t c 
may be estimated as the solution of the following transcendent equation: 

e^Mt c /2 = a exp(-At c ) (25) 

which holds on the spatial scales already reached by the diffusion process: 



ey/Mt/2 > A , (26) 

beyond which the value of the entropy still depends on the size of A (i.e. the 
curves S'b(A) display the behavior S^i, A) ~ A 2 ). For example, in the case with 
e = 10 -4 , a = 0.01, M = 100 and A = 0.162, one obtains t c ~ 9, and, in agreement 
with our interpretation, for t > 9, all the curves in FigEl present the same slope 
compatible with the Lyapunov exponent A. 

As a numerical check of the consistency of this approach, we studied system 
(I23|) . The results with a given D should be compared with those of the deterministic 
system of Eq. fTT|) with 

e = eeq ^ 2 {rr (27) 

The results, shown in FigJH] and are qualitatively similar to the deterministic 
interacting case (|17|). confirming the validity of our approach. 

A similar reasoning leads to the decoherence mechanism proposed by Zurek and 
Paz p8 for the semiclassical limit of quantum mechanics. We note that rather sub- 
tle conceptual points are present in the decoherence process for the semiclassical 
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limit. This is so because two theories are involved (classical and quantum mechan- 
ics) with very different ontological status (deterministic and non-deterministic, re- 
spectively). In our problem one has just a technical aspect: roughly speaking, one 
mimics the first equation of the BBGKY hierarchy of a diluted system, consisting 
of weakly interacting chaotic particles, with a suitable Fokker-Planck equation. 



3.5 




2 4 6 8 10 12 14 16 18 20 
t 

Figure 8: Numerical simulation of N = 10 7 independent particles evolving accord- 
ing to ()23|) with e eq = 10~ 4 . Notice the similar qualitative behavior observed in 
Fig.®. 
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Figure 9: Extrapolation for A — > of the curves SSsit, A) as a function of t for 
various values of e eq . Notice that the extrapolated curves are qualitatively similar 
to the interacting case (cf. Fig. [HJ) • 
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5 Conclusions and perspectives 



We have studied a system made of weakly coupled chaotic subsystems, which can 
be considered as a model of weakly interacting particles in an environment with 
convex obstacles. In the non interacting limit the behavior of the Boltzmann 
entropy depends strongly on the coarse-graining resolution (i.e. the cell size A) 
and therefore it cannot be considered an intrinsic property of the system. By 
contrast, in the weakly interacting case the behavior of the Boltzmann entropy 
becomes independent of the observation scale, assuming an objective character: 
for A small enough, i.e. smaller than A*(e, A), one observes a well defined shape 
of SSsit) vs t. A remarkable fact is that 5SB(t), for t > t*(e, A), increases roughly 
linearly, with a slope given by the Kolmogorov-Sinai entropy of the single (non 
interacting) chaotic system. Summarizing, the interaction is necessary in order to 
have an effective cell size A*, thus changing the time behavior of the Boltzmann 
entropy from "subjective" to "objective", while other numerical aspects, like the 
slope of 5SB(t)ioi t > t*, are basically determined by the degree of chaos in the 
single subsystems. In addition, the effect of the weak coupling among the chaotic 
subsystems can be successfully modeled with a noisy term, and this allows us to 
estimate the value of t*(e, A). 

Let us now comment on the relevance of these results for the case of nonin- 
teracting particles, in a host environment made of very heavy particles. If the 
"obstacles" were not infinitely massive, they would exchange energy with the in- 
dependent particles, like the case of photons in a black body cavity. The photons 
do not interact with each other, but interact with the walls, reach a thermal equi- 
librium with them, and acquire a temperature for themselves. A similar behavior 
has been obtained in the Lorentz-like model of Ref.j2H]- In our framework, this 
would amount to set the interaction e to zero, and to switch on an interaction 
between particles and obstacles which now are allowed to move. Denoting with Yj 
and Wj the coordinate and the momentum of the J-th obstacle, one can introduce 
a symplectic dynamics, which generalizes (j!5|) introducing a suitable interaction 
among the "light" particles and the heavy obstacles. Of course now the V space 
is given by (Q,Y;P, W). Then, the "light" particles would be indirectly coupled 
with each other, as in (2H|: indeed, the heavy particles will play the role of inter- 
action carrier particles and essentially we would fall back in the case considered in 
this paper. Clearly, an interaction carried by heavy particles will be very weak and 
will involve very small scales, which are difficult to observe in numerical simula- 
tions; nevertheless, there are no reasons to expect any conceptual difference from 
the scenario described in the present paper, which is consistent with the results of 
Ref.[2Hl. 

Of course, our results do not rule out noninteracting particle systems from the 
class of physically relevant models. In fact, they can be quite useful in describing 
highly rarefied gases, such as those of high vacuum pumps, or in the upper layers 
of the atmosphere. Recently, they have also proven to be useful in the description 
of transport in microporous membranes ^7j, which are of a strong technological 
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interest. Therefore, credit must be given to those who have analyzed, and popu- 
larized these models, in the framework of nonequilibrium statistical mechanics (cf. 
[T27 ITS] and references therein). Similarly, we do not exclude that some version 
of the coarse-grained Gibbs entropies may serve as useful characterizations of the 
state of certain systems. Our results indicate that such systems, and such defi- 
nitions of entropy, are not appropriate to understand, from a theoretical point of 
view, what happens in thermodynamic systems where the macroscopic evolutions 
toward equilibrium involve all the relevant microscopic degrees of freedom. 
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